1 link tagged with all of: evaluation + signal collapse + ai
Click any tag below to further narrow down your results
Links
The author argues that AI makes cheap to fake the signals we use to judge quality, such as GitHub stars, polished writing, and homework passing autograders, so good work stops getting rewarded and a market for lemons forms. He uses signaling theory to explain why this change is so fast and disorienting compared with earlier, slower erosion.
- Shortcuts like stars, clean READMEs, and passing tests worked because faking them used to cost nearly as much as doing the real work; AI removes that cost gap.
- Buying GitHub stars already cost about $0.07โ0.20 each, and AI now makes fake accounts with realistic histories easy to produce, hiding the fakery better.
- When signals collapse, evaluation gets more expensive, and buyers, employers, and reviewers stop paying a premium for good work, so poor work dominates, as in Akerlof's 1970 used-car lemons paper.
- Past signal erosion (biological mimicry, CAPTCHAs, pass/fail grading) was usually slow, but AI is breaking many signals across open source, education, and research at once.